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Effects of the backward scattering with large momentum transfer are examined in two- 
dimensional electron system with a special emphasis on electrons around (tv,0), (0,tt). The 
phase diagram is shown in the plane of temperature T and hole doping 6 in the mean field 
approximation and it is found that ci-wave superconductivity, antifcrromagnetism and 7r-triplct 
pair can coexist near half filling. 
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In recent years the electronic states in two-dimensional systems in the hole-doped copper ox- 
ide high-T c superconductors have been studied intensively. Especially, the anomalies in the normal 
state around (vr,0) and (0,7r) have been elucidated in the angle resolved photoemission spectroscopy 
(ARPES) experiments Near optimal hole doping, a very flat dispersion of quasiparticle excitations 
near the Fermi level around (vr,0) and (0,7r) has been reported in materials such as YBa2Cu307_5 
(YBCO) or Bi 2 Sr 2 CaCu20 8+5 (BSCCO).& This flatness of dispersion is more prominent than that 
obtained in the single-particle band calculations such as local-density approximation (LDA).i'& 
This 'extended' saddle-point behavior has been attributed to the many-body correlation effects 
based on the results of quantum Monte Cairo (QMC) simulations,^ and propagator-renormalized 
fluctuation-exchange (FLEX) approximation,!) or to the dimple of the Cu02 planes from the re- 
cent LDA calculations.^ On the other hand, in the underdoped region, a pseudogap of the d x 2_ y 2 
symmetry has been observed around (it,0) and (0,7r) above the superconducting critical temper- 
ature.i'i'0* It has been indicated that there is strong coupling between quasiparticle excitations 
near the flat band and collective excitations centered near (7r,7r).0) 

Theoretically, such experimental features that the Fermi level approaches (vr,0) and (0,7r) as hole 
doping rate is increased from half filling can be described by introducing not only nearest-neighbor 
hopping t but also next-nearest-neighbor hopping i! . Actually studies looking for the instabilities 
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with a special emphasis on (ir,0) and (0,7r) in the 2D Hubbard model have been carried out, by 
use of the renormalization group methodSE! and QMC.0 These studies have shown that d-wave 
superconducticity prevails over antiferromagnetism by the effect of t 1 . In this letter, we consider 
the situation that the Fermi level approaches (vr,0) and (0,7r) as hole doping rate is increased from 
half filling. With a special emphasis on the effects of the backward scattering processes with large 
momentum transfer between two electrons near (tt,0) and (0,7r), we search for possible ordered 
states in the mean field approximation. It is found that three order parameters, ri-wave Cooper 
pair, Neel order and 7r-triplet pair are stabilized, and the phase diagram in the plane of temperature, 
T, and hole doping rate, 5, has been determined. We take unit of ft = /cb = 1- 
We consider two-dimensional square lattice with the kinetic energy given by, 

H o = ~ ^A c \a c 3<y + ( h - c -)} - vJ2 c t c ^> 

<ij>cr i 

per 

where tij is the transfer integral, Ci a (c irT ) is the annihilation (creation) operator for the electron on 
the i-th site with spin a, and fi is the chemical potential. The energy dispersion is given by 

£ p = — 2t(cosp x + cospy) — 4t' cos cospy — 2t"(cos 2p x + cos 2p y ) — [a, (2) 

including t (nearest neighbor), t' (next nearest neighbor) and t" (third neighbor), as shown in 
Fig. 1. 



Fig. 1. Transfer integrals on a 2D square lattice; t (nearest neighbor), t' (next nearest neighbor) and t" (third 
neighbor) . 



We take t as the energy unit, i.e., t = 1. The lattice constant is also taken as unity. We choose 
the values of t' and t" so that the Fermi surface of YBCO type is reproduced near half filling. In 
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this letter, we take the following choice as 



t'/t 



1/6, t"/* = 1/5. 



(3) 



In order to treat the scattering processes between two electrons around (tt,0) and (0,7r) unambigu- 
ously, we take the Brillouin zone as shown in Fig. 2, which consists of the region A and B including 
(7r,0) and (0,7r), respectively. We note that w p = sgn(cospj / — cosp x ) = +1(— 1) for p €A(B). The 
Fermi surface in the half-filled case is also shown in Fig. 2. 



Fig. 2. The choice of the 1st Brillouin zone which consists of the region A and B including (tt,0) and (0,7r), respec- 
tively, and the Fermi surface in the half-filled case for t'/t — —1/6 and t" /t = 1/5. 

Next we consider the interaction term. We can introduce effective interaction between two 
electrons in the region A and B, just as in the g-ology in one-dimensional electron system. Here we 
treat only the backward scattering with large momentum transfer, shown in Fig. 3, i.e., g\ and g^, 
in analogy with normal and Umklapp processes in our previous work for one-dimensional electron 
system © We take only interaction between two electrons with antiparallel spins into account, as 
in the Hubbard model, i.e., g\ = g\± and 53 = g^±. 

We treat the above Hamiltonian in the mean field approximation under the assumption g\ = 
53 — g > for simplicity. By noting that there exist the scattering processes as shown in Fig. 4, we 
naturally introduce the following order parameters, i.e., Cooper-pair with total momentum equal 
to zero in the original 1st Brillouin zone which can be expressed as follows, 




(4a) 



k k 
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Fig. 3. Backward scattering processes with large momentum transfer. The solid and dashed lines stand for electrons 
in the region A and B, respectively. 



and staggered carrier density of each spin, 

A t = 5 < c Q B +k^ c QA+k\ >, Aj. = g < c Q B -H c QA-kl >, (4b) 



k 



and 7r-pair 



A + = dYj < c QA-klCQ B +ki >, A_ = g^' < CQ s -fc|CQ A+fcT >, (4c) 

k k 

where Qa = (tt,0) and Qb = (0,vr), respectively, and 

E'= £ • 

k \k x \ + \k y \<-K 

It is to be noted that Qa i k and Qb i fc always lie in the region A and B, respectively, for k 

satisfying \k x \ + \k y \ < 7r. This is the reason for the choice of the Brillouin zone as shown in Fig. 2. 
We take 

Ai = A A = -A B , (5a) 

A 2 = 2A T = -2AJ, (5b) 

A 3 = A+ = -A_, (5c) 

so that each of the above three order parameters is possible independently of each other for g > 0. 
They stand for <i-wave Cooper-pair, Neel order and 7r-triplet pair, respectively. We note that A 2 
is real for g\ = g%. Our g^ processes included in the Cooper channel are the same as the 'pair- 
tunneling' of two electrons located around (vr,0) and (0,7r), which favors d x 2_ y 2 pairing, in the 2D 
Hubbard model© These interaction processes are not present as important factors in the recent 
model by Assaad et al, who have introduced the additional interaction expressed as the square of 
the single-particle nearest-neighbor hopping. 
We obtain the mean field Hamiltonian as follows: 

H MF = Y!4 M k^k + H c , (6a) 
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Fig. 4. Interaction processes considered in the mean field approximation, (a) Cooper channel, (b) density-wave 
channel, (c) 7r-pair channel. 



Wi — ( C Q A +kV C QA-kli c Q B +kV C QB-ki)i 



M k 



a k -Ai -A 2 A 3 
-A* -a k -AJ -A 2 
-A 2 -A 3 b k Ai 



V as 



-A, Ai 



1 



^ c = -{2(|A 1 | 2 + |A 3 n + (A 2 )^}- /[ /. 
There are four quasiparticle energy bands, ±.E_|_(fc) and ±E_(k), 



E±(k) = J + |Ax|2 + (A 2 )2 + |A 3 | 2 ± A(k), 



(6b) 

(6c) 

(6d) 
(6e) 

(7a) 



A(k) = 



\ 



(ak ~ h) 2 



a k 



+ bk\ 



2 J 

The self-consistent equations are given by 



+ |A a 



+ [(a fc + 6 fc )(A 2 )-2Re(AJA 3 )]2. (7b) 



Ai 



'E'E^tanh^llA,^ 2 ^ 



' y 

2 V .4-! E a (k) 



2T 



A 2 = ^LL 7T77T ta nh -^r~ { A 2 



A, 



2T 



(a* + h) 2 



fc a=± 



£ a (fc) 



2T 



1 + Q 

1 + a 



[Re(A;A 3 )-a fc A 2 ]|, 

2Re(AJA 3 )a fc ' 



2A(k) 

{ak ~ h) 2 
2A(k) 



a- 



A(k) 



2A 



+ a W) [ Re (A!A 3 )-a fc A 2 ]|, 



where n is the electron filling, which is related to hole doping S by 5 = 1 — n. 

These equations are solved numerically, under the assumption that both and A3 are real. 
The resultant phase diagram is shown in Fig. 5 in the plane of T and 5 for a choice of g/t = 5.0. In 
this case we find that d-wave superconductivity (dSC), antiferromagnetism (AF) and 7r-triplet pair 
can coexist near half filling. Such a close relationship between dSC and AF has been indicated by 
SO (5) theory© We note that if two of three order parameters coexist, another one always results. 
It is noted that the stability of antiferromagnetism near half filling is not due to the nesting but 
due to scattering processes involving both g\ and 53. 



Fig. 5. The phase diagram in the plane of T and S for a choice of g/t = 5.0. 



In summary, we have studied possible ordered states of interacting electrons on a square lattice 
with a special emphasis on the backward scattering, g\ and 53, i.e., 'exchange' and 'Umklapp' 
processes, respectively, between two electrons around (tt,0) and (0,7r) for the case of YBCO type 
Fermi surface. If we take 51 = 53 > 0, d-wave superconductivity (dSC), antiferromagnetism (AF) 
and 7r-triplet pair can coexist near half filling. On the other hand, the results of our preliminary 
calculations indicate that for g\ 7^ 53 dSC can compete with AF and especially for g\ = dSC 
prevails over AF in the half-filled case. On the other hand, in the case of electron-doped materials 
such as Nd2- a; Ce a ;Cu04 +( 5 (NCCO), the Fermi level lies far above (ir,0) and (0,7r), but gets close 
to (±7r/2, ±7r/2))i) for which recent QMC calculations show that not only d x 2_ y 2 but also d xy 
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pairing correlation are enhanced in the 2D Hubbard modelO These results indicate that there 
exists a variety depending on the shape of the Fermi surface and scattering processes, which will 
be reported in detail elsewhere. 
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